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ABSTRACT 


General  conditions  are  given  for  the  convergence  of  a  class 
of  cutting-plane  algorithms  without  requiring  that  the 
constraint  sets  for  the  subproblems  be  sequentially  nested. 
Conditions  are  given  under  which  inactive  constraints  may  be 
dropped  after  each  subproblem.  Procedures  for  generating 
cutting-planes  include  that  of  Kelley  [4]  and  a  generaliza¬ 
tion  of  that  used  by  Zoutendijk  [12]  and  Veinott  [9].  For 
algorithms  with  nested  constraint  sets,  these  conditions 
reduce  to  a  special  case  of  those  of  Zangwill  [10]  for  such 
problems  and  include  as  special  cases  the  algorithms  of 
Kelley  [4]  and  Veinott  [9].  An  arithmetic  convergence  rate 
is  given. 


CUTTING-PLANE  METHODS  WITHOUT  NESTED  CONSTRAINT  SETS 


by 
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Donald  M.  Topkis 


I  consider  the  problem  of  maximizing  a  real-valued  continuous  function  f 
over  a  nonempty  closed  subset  S  of  E°  .  It  is  assumed  throughout  that  one 
is  given  a  closed  subset  T  of  En  such  that  S  C  T  and  f  attains  its 
maximum  over  every  nonempty  closed  subset  of  T  .  The  general  algorithm  to  be 
considered  proceeds  by  setting  Tq  *  En  ,  and,  given  T^  as  the  intersection  of 
En  and  a  finite  set  of  closed  half-spaces  containing  S  ,  picking  x^  to 
maximize  f  over  T^  fi  T  ,  stopping  if  x^  e  S  ,  and  otherwise  letting  be 

the  intersection  of  E°  and  a  subset  of  those  half-spaces  determining  T^  such 
that  x^  maximizes  f  over  0  T  ,  finding  a  closed  half-space  containing 

S  but  not  xfc  ,  setting  0  ,  and  continuing. 

T^  will  be  intersection  of  En  and  at  most  k  closed  half-spaces.  It  is 
easily  seen  that  if  T  is  convex  and  f  is  pseudo-concave^  or  concave  on  T  , 
then  will  satisfy  the  above  conditions  if  is  the  intersection  of  all 

the  half-spaces  determining  T^  for  which  x^  is  on  the  boundary  and  any  subset 


I  am  grateful  to  Professor  Richard  Van  Slyke  for  bringing  Reference  [6]  to  my 
attention  and  pointing  out  the  relevance  of  the  concept  of  uniform  concavity 
which  allowed  the  hypotheses  of  Lemma  7  to  be  weakened  somewhat  from  an  earlier 
version  framed  in  terms  of  the  matrix  of  second  partial  derivatives  of  f  at 
points  of  T  . 

*  Conditions  for  this  are  given  in  Corollary  11,  and  it  is  clearly  true  when  T 
is  compact. 

^  A  real-valued  function  f  is  pseudo-aonaaoe  [7]  on  a  convex  set  T  c  En 
if  f  is  differentiable  on  T  and  (y  -  x)*Vf(x)  i  0  for  y  ,  x  e  T  implies 
f (y)  £  £ (x)  .  A  differentiable  concave  function  is  pseudo-concave. 
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of  those  half-spaces  determining  for  which  x^  is  an  interior  point.  To 

be  applicable,  of  course,  the  subproblems  (which  have  linear  constraints  when  T 
is  a  convex  polyhedron)  must  be  significantly  easier  to  solve  than  the  original 
problem,  and  hence  this  procedure  is  essentially  confined  to  problems  in  which  f 
is  either  linear,  quadratic,  or  separable  in  which  cases  relatively  efficient 
algorithms  [1,2,5]  exist  for  the  subproblems.  The  algorithms  of  Kelley  [4] 
and  Veinott  [9]  set  »  T^  for  all  k  so  each  T^  is  the  intersection  of  k 
closed  half-spaces  and  E°  .  If  each  is  the  intersection  of  En  and  those 

half-spaces  determining  T^  for  which  x^  is  a  boundary  point,  then  it  is  seen 
by  Lemma  12  that  each  T^  is  the  intersection  of  no  more  than  n  +  1  closed 
half-spaces  and  En  . 

Since  x,  maximizes  f  over  S.  H  T  ,  x,  , ,  maximizes  f  over  T,  ,  H  T  , 
k  k  k+1  k+1 

*"d  Sk  n  T  -  Tk+1  n  T  -  s  • 

(1)  f(x.)  >  f(x  )  >  max  f(x)  . 

*  A  -  xcS 

The  following  slight  generalization  of  an  observation  of  Kelley  [4]  is  clear 
from  (1) . 

Theorem  1: 

If  x^  e  S  for  some  k  ,  then  x^  is  optimal.  If  x^  t  S  for  all  k 
and  the  limit  point,  x  ,  of  some  convergent  subsequence  of  {x^}  is  feasible, 
then  x  is  optimal. 

The  conditions  of  Theorem  10  (which  were  already  indicated  to  be  sufficient 
for  another  basic  assumption  in  the  first  footnote)  assure  that  {x^}  is  bounded 
and  hence  has  a  convergent  subsequence.  Thus,  the  real  problem  is  to  find  conditions 
under  which  the  limit  point  of  any  convergent  subsequence  of  {x^}  is  feasible, 
and  this  is  considered  in  Section  1. 
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1.  GENERAL  CONVERGENCE  CONDITIONS  AND  EXAMPLES 

A  mapping  (a(x),b(x))  from  T  -  S  into  En+^  with  a(x)  e  En  and 

b(x)  c  E1  is  a  limiting  cutting-plane  function  if  S  £  H(x)  =  {y  :  a(x)»y  >  b(x)} 

for  all  x  c  T  '  S  ,  (a(x),b(x))  is  bounded  on  any  bounded  subset  of  T  -  S  , 

and  for  any  {x,  :  k  -  1,2,  Cl  *  S  with  lim  x,  *  x  e  T  *  S  the  limit  point 

14  “  k-*» 

(a,b)  of  any  convergent  subsequence  of  { (a(xk) ,b(xk>) }  satisfies  a*x  <  b  .+ 

The  notion  of  a  limiting  cutting-plane  function  was  introduced  by  Zangwill  [10]. 

He  applied  a  generalized  version  of  this  notion  to  a  class  of  cutting-plane 
algorithms  with  to  obtain  a  result  for  which  Corollary  5  is  a  special 

case.  In  addition,  he  presented  Lemma  3  and  proved  a  special  case  of  Lemma  4  with 
B  -  {0}  . 


Theorem  2; 


If  H(x)  is  determined  by  a  limiting  cutting-plane  function. 


"k '  H(V  ■ 


lim  x  -  lim  x  ■  x  ,  and  x  s  H.  for  all  I  ,  then  x  is  optimal. 
i***°  i  i-*-  Ji  Ji  *i 


Proof: 

Since  (a(x),b(x))  is  a  limiting  cutting-plane  function  and  x  c  H,  *  h/x.  \ 

Ji  i  \  *i/ 

for  all  i  , 


(2)  •(*k1),xjl  :  b(xk1j  "  1(xk1)-xk1  £or  311  1  • 


If  (a,b)  is  the  limit  point  of  any  convergent  subsequence  of  |  |a|x^  j.b^x^  , 
then  it  follows  from  (2)  that  a*x  *  b  .  Hence,  x  is  feasible  since  (a(x),b(x)) 


*  If  T  is  convex  and  a  cutting-plane  function  exists,  then  it  is  easily  seen 
that  S  is  convex. 
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is  a  limiting  cutting-plane  function,  and  so  x  is  optimal  by  Theorem  1.  // 

The  following  two  lemmas  give  examples  of  limiting  cutting-plane  functions. 

The  function  of  Lemma  3  was  introduced  by  Kelley  [4].  The  special  case  of  the 

function  of  Lemma  4  with  B  =  {0}  was  introduced  by  Zoutendijk  [12]  although 

/ 

he  gave  no  proof  for  his  algorithm,  and  a  slightly  modified  version  of  his 
algorithm  was  proven  to  converge  by  Veinott  [9].  Throughout,  suppose  that 
S  *  {x  :  G(x)  >  0}  where  G(x)  is  a  real-valued  continuous  function  on  T  . 

Lemma  3: 

Suppose  that  there  exists  a  function  y(x)  from  T  ~  S  into  En  which 
is  bounded  on  any  bounded  subset  of  T  -  S  and  such  that  G(y)  <  G(x)  +  y(x)*(y  -  x) 
for  all  x  c  T  -  S  and  y  e  S  .  Then  (y(x),y(x)*x  -  G(x))  is  a  limiting 
cutting-plane  function. 


Proof : 

Clearly,  S  C  H(x)  .  Pick  {x,  }  •  s  with  lim  x  *  x  c  T  '  S  .  Then 

lv  .  K. 

k-*” 

the  limit  point  of  any  convergent  subsequence  of  {(y (x^) ,y (x^) • x^  -  G(xk>}  takes 
the  form  (y,yx  -  G(x))  .  But  G(x)  <  0  since  x  e  T  *  S  so  y*x  <  y*x  -  G(x)  .// 

Kelley  [4]  observed  that  if  T  is  convex  and  G(x)  -  min  g.(x)  where 

l<i<m 

each  g^  is  differentiable  and  concave  on  T  then  y(x)  -  satisfies 

the  conditions  of  Lemma  3  if  i(x)  is  chosen  such  that  G(x)  -  gi(x)^x^  * 

Lemma  4; 


Suppose  there  exists  t  with  G(t)  >  0  ,  s  is  convex,  and  for  x  c  T  -  S  define 
A(x)  ■  sup[A  :  Ax  +  (1  -  A) t  e  S}  and  set  w(x)  -  o(x)x  +  (1  -  a(x))t  for  any 


o(x)  c  (A(x),lJ  with 


G(w(x)) 

G(x) 


e  B  where  B  is  a  nonempty  subset  of  [0,1]  . 


Suppose  also  that  for  P  -  {w  :  there  exists  x  e  T  *  S  with  w(x)  -  w}  there 
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exists  a  function  y(w)  from  P  into  En  which  is  bounded  and  bounded  away 
from  0  on  any  bounded  subset  of  P  and  such  that  0  <  G(w)  +  y(w)*(y  -  w) 
for  all  w  c  P  and  y  c  S  .  Then  X(x)  e  (0,1)  for  all  x  e  T  *  S  and 
(y(w(x)),y(w(x))»w(x)  -  G(w(x)))  is  a  limiting  cutting-plane  function. 

Proof : 

Pick  any  x  e  T  -  S  .  If  X(x)  >  1  then  there  exists  z  e  S  and  y  c  (0,1) 

with  x  ■  Yt  +  (1  -  Y)*  which  contradicts  the  convexity  of  S  .  Also,  X(x) 

cannot  equal  1  since  this  would  imply  that  x  c  S  because  S  is  closed ,  so 

X(x)  <  1  .  Since  G(t)  >  0  ,  it  then  follows  that  X(x)  e  (0,1)  . 

Now  pick  {x,  }  c  t  '  S  with  lim  x,  ■  x  e  T  -  S  .  Then  the  limit  point  of 

k  k-*« 

any  convergent  subsequence  of  {(y(w(x^)) ,y  (w(x,  ))  »w(x^)  -  G(w(x^)))}  takes  the 
form  (y,yw  -  G(w))  where  y  +  0  .  Let  a  be  the  limit  point  of  any  convergent 

subsequence  of  the  corresponding  subsequence  of  {a(xk)}  .  Then 

w  *  ox  +  (1  -  a)t  ,  a  e  [0,1]  ,  and  w  c  En  *  S  imply  a  >  0  and  G(w)  <  0  . 

But  since  t  is  in  the  interior  of  S  ,  y  ^  0  ,  and  clearly 

0  <  G(w)  +  y • (y  -  w)  for  all  y  e  S  , 


it  follows  that 

(3)  0  <  G(w)  +  y* (t  -  w) 

and  so  by  (3)  and  G(w)  <  0 
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0  <  u* (t  -  w)  . 


But  t  -  w  =  o(t  -  x)  and 


x  -  w  »  (1  -  a)  (x  -  t) 


■m 


(t  -  w) 


and  so  by  (4)  and  (5)  if  a  <  1 


0  >  w*  (x  -  w) 


and  by  (6)  and  G(w)  <  0 


0  >  G(w)  +  y • (x  -  w)  . 


If  a  *  1  then  w  *  x  and  (7)  still  holds. 

Since  by  hypothesis  S  C  H(x)  for  all  x  e  T  ~  S  ,  the  proof  is  complete.  // 

Suppose  G(x)  -  min  g .  (x)  where  each  g  is  a  real-valued  differentiable 
l<i<m  1  1 

function  on  En  .  Veinott  [9]  showed  that  when  B  =  {0}  ,  each  is  quasi-concave"*" 

on  En  ,  i(x)  is  any  i  such  that  G(x)  *  (x)  >  and  G(x)  *  0  implies 

Vgl(x)(x)  t  0  ,  then  for  y(x)  *  ^®i(x)^  t^ie  ^yPotV|eses  about  y(x)  in  Lemma  4 
are  satisfied.  For  arbitrary  B  c  [0,1]  it  is  easily  seen  that  if  each  g^(x)  is 
concave  and  y(x)  ■  ^8^x)(x)  (with  i(x)  as  above)  then  this  y(x)  satisfies 
the  hypotheses  of  Lemma  4.  The  method  of  Lemma  4  with  B  -  (0,1)  and  o(x)  e  (X(x),l) 
would  seem  to  compare  favorably  with  Kelley's  method  (which  requires  a(x)  ■  1  , 
but  does  not  assume  the  existence  of  t  with  G(t)  >  0)  because  the  cutting-plane 
for  x  is  generated  by  a  point  "closer"  to  S  than  x  ,  and  the  advantage  over 
Veinott's  method  is  that  with  B  ■  {0}  finding  a(x)  exactly  is  generally  not 


^A  real-valued  function  f  is  quasi-concave  [7]  on  a  convex  set  T  if 

{x  :  f(x)  >  a  ,  x  e  T}  is  convex  for  all  real  a  .  A  concave  function  is  quasi¬ 


concave  . 


always  possible  (although  here  one  would  need  each  to  be  concave  while  he 

only  required  them  to  be  quasi-concave).  Finally,  observe  that  when  B  *  {1} 
and  a(x)  *=  1  the  method  of  Lemma  A  is  identical  with  that  of  Lemma  3. 
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The  following  is  an  immediate  consequence  of  Theorem  2  by  letting  ■  k^+^  • 

Corollary  5: 

If  H(x)  is  determined  by  a  limiting  cutting-plane  function,  ■  H(x^)  , 
and  ■  T^  ,  then  the  limit  point  of  any  convergent  subsequence  of  {x^}  is 
optimal. 

Corollary  5  together  with  Lemma  3  proves  Kelley’s  algorithm  [A],  and  Corollary 
5  together  with  Lemma  A  proves  Veinott’s  algorithm  [9]  and  a  more  general  class 
of  cutting-plane  algorithms. 

The  following  result  paves  the  way  for  generating  cutting-plane  algorithms 
in  which  inactive  constraints  (i.e.,  half-spaces  determining  T^  for  which  x^ 
is  an  interior  point)  may  be  dropped  after  each  subproblem.  It  follows  immediately 
from  Theorem  2  by  letting  j ^  *  k^  +  1  since  x^  +1  e  T 

Corollary  6: 

If  H(x)  is  determined  by  a  limiting  cutting-plane  function,  *  H(xk)  ,  and 

lim  x,  ■  lim  x,  .  ■  x  ,  then  x  is  optimal. 
i-*°  i  i-*»  ki 

In  order  to  apply  Corollary  6  it  is  necessary  to  explore  conditions  under 

which  lim  x,  **  lim  x,  .  ,  and  for  this  purpose  the  following  notions  are 
i-*®°  l  h 

considered. 

A  real-valued  function  f  is  uniformly  concave  (6)  on  a  convex  set  T  if 
there  exists  a  nondecreasing  function  5(r)  >  0  on  (0,®)  such  that 
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f(4(x  +  y))  >  ljf(x)  +  ljf(y)  +  6(|x  -  y|) 


for  all  x  ,  y  c  T  .  A  uniformly  concave  function  is  strongly  concave  [6]  If 
2 

6(r)  ■  Yr  for  some  y  >  0  .  It  is  easily  seen  that  if  T  is  compact,  f  has 
continuous  second  partial  derivatives  on  T  ,  and  the  matrix  of  second  partial 
derivatives  of  f  is  negative  definite  at  all  points  of  T  ,  then  f  is  strongly 
concave  on  T  . 


>mma  7; 


If  T  is  convex,  f  is  uniformly  concave  on  T  ,  and  11m  x.  ■  x  then 

i-“  i 

lim  x.  , .  -  x  , 

x-  V1 


Proof : 


Since  x.  maximizes  the  concave  function  f  over  the  convex  set  S.  0  T 
\  ki 


and  x 


Ckt+1  C  Tki+1  n  T  -  Skt  n  T  ’  f|xk1j  -  f(iS(X'li  +  Xkt+1))  *  ThUS 

(\)  i  f(\ ♦ v)) !  v{\) + +  4K '  V1') 

f(\)  •  f(\+i)  :  2i(<\  -  xkt+il)  •  *° 


(8)  *  *  *(\)  *  5  fW  ;  '(\)  '  £  f(\)  ’  Jx  d\)  *  £M) 

;  Jx  (£K)  •  £M) 1 2  Jx  ‘K '  V1') 

But  (8)  implies  that  lim  i^x^  “  x^  +^|  j  ■  0  ,  and  since  6(»)  is  positive  and 


s 
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nondecreasing  on  (0,»)  this  implies  that  lim  |x.  -  x.  .  |  •  0  .  // 

t+~  Ki  ki 1 

Clearly  the  maximum  of  a  uniformly  concave  function  on  a  convex  set  is 
unique  if  it  is  attained.  Thus,  Theorem  10  (which  together  with  the  hypotheses 
of  Theorem  8  and  the  earlier  assumption  that  f  attains  its  maximum  on  T 
Implies  that  {x^}  is  bounded),  Corollary  6,  and  Lemma  7  yield  the  following 
result  which  allows  Inactive  constraints  to  be  dropped  after  each  subproblem. 


theorem  8: 


If  H(x)  is  determined  by  a  limiting  cutting-plane  function,  ■  H(xk>  , 
T  is  convex,  and  f  is  uniformly  concave  on  T  ,  then  {x^}  converges  to  the 
unique  maximum  of  f  on  S  . 
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2.  CONVERGENCE  RATES 

Levitin  and  Polyak  [6]  have  established  an  arithmetic  convergence  rate  for  a 
cutting-plane  algorithm  which,  when  specialized  to  subsetsof  En  ,  has 
(although  their  proof  still  holds  if  inactive  constraints  were  dropped  after  each 
subproblem)  and  uses  the  cutting-plane  method  of  Lemma  3.  Here  their  algorithm 
and  method  of  proof  are  generalized  to  show  the  same  convergence  rate  for 
algorithms  which  allow  inactive  constraints  to  be  dropped  after  each  subproblem  and 
for  which  the  cutting  plane  at  x  e  T  *  S  may  be  generated  at  some  point 
w(x)  e  T  -  S  other  than  x  on  the  line  segment  joining  x  to  a  point  t  with 
G(t)  >  0  (as  in  Lemma  4,  although  here,  unfortunately,  w(x)  must  be  bounded 
away  from  S)  . 


Theorem  9: 

Suppose  that  S  ■  {x  :  G(x)  >_  0}  ,  T  is  convex,  G(x)  is  concave  on  T  , 
there  exists  t  with  G(t)  >  0  ,  and  for  x  e  T  -  S  define 

A(x)  ■  sup  {\  :  Ax  +  (1  -  A)t  e  S)  and  set  w(x)  *  a(x)x  +  (1  -  a(x))t  for  any 
a(x)  e  [ A  (x) ,  1  ]  with  G(w(x))  cG(x)  where  0  <  e  <_  1  .  Suppose  also  that  for 
P  *  {w  :  there  exists  x  e  T  -  S  with  w(x)  ■  w)  there  exists  a  function  y(w) 
from  P  into  E°  with  |y(w)|  <_  K  for  all  w  e  P  and  such  that 
0  _<  G(w)  +  u(w)*(y  -  w)  for  all  w  e  P  and  y  e  S  and  let 

-  {x  :  0  <^G(w(x^))  +  u(w(x^))  *  (x  -  w(x^))}  .  ?.f  T  is  compact,  f  is 
strongly  concave  and  differentiable  on  T  ,  and  x  is  the  unique  maximum  of  f  on 
S  ,  then  for  k  >  1 


f(xfc)  -  f(x)  < 


t 


See  the  remarks  following  Lemma 


4. 


i 
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and 


where 


.  .  2y(-£^2  .  • 

al  Y\Kbd  /  ’  2  Kbd 

d  ■  max  { |  Vf  (y)  |  :  y  e  1}  ,  b  *  max  {  |  y  —  1 1  :  y  e  I)  ,  and  y  is  as  in  the 
definition  of  strong  concavity. 

Proof : 

Let  *k  -  A(xk)  ,  ak  -  a(xk)  ,  -  w(xk>  ,  and  uk  ■  u(wk>  •  Clearly, 

G(Xkxk  +  (1  -  *k)t)  »  0  and  so  by  concavity 

0  ’  G(Xkxk  +  (1  '  -  XkG(xk}  +  (1  “  VG(t) 


and 

(9)  -G(xr)  >_  j-  (1  -  Ak)G(t)  >  (1  -  Xk)G(t)  . 

Ak 

Since  t  e  S  , 

(10)  0  <_  G(wk)  +  Pk*(t  -  wfc)  . 

But  xk  is  the  unique  maximum  of  f  on  Sk  A  T  and  it  is  easily  seen  that 
xk  i  Hk  so  j*  xk+1  c  Tk+1  AT-HknSkAT  and  by  the  strict  concavity  of  f 
on  T  , 

0  -  0(wk)  +  uk-(xk+l  -  »k) 


(11) 
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0  .  G(wk>  +  Vk-(xk+1  -  xk)  +  (1  -  ak)v(xk+1  -  t) 


By  (10)  and  (11) 


°- V(Vi  -  • 


SO  by  (12)  and  (13) 


o  i  G(wk)  +  «k)Jk-(xk+1  -  xk)  <  £G(xk)  +  K|: 
By  the  concavity  of  f  and  the  optimality  of  x  , 


Xk+1  “  xk'  * 


f(xk) 


f(x)  <  f(xk)  -  f(Xkxk  +  (i  .  y,.) 

- (1  •  V(xk  -  t),7f(xkxk  +  (i  -  yo 
-  (1 "  Vlxk  •  tl*l7f(xkxk+  (1  *  yo 


1  (1  -  Ak)bd  . 


Combining  (15),  (9),  and  (14), 


f(*k) 


f(x)  1  (1  -  Xk)bd 


-  G(t)  (“G^xk))bd 


-  cG(t)  |Xk  "  xk+l'  • 


Xk  *  xk+l  E  \  ^  anc*  xk  oaximizes  the  strongly  concave  function 
f  over  the  convex  set  Sfc  f)  T  ,  for  some  Y  >  0 


<17)  f(xk>  *  +  xk+l»  i  «<*k>  +  «<x  >  +  y 


k+l'  T  y'xk  -  xk+ll 
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3.  SOME  USEFUL  ANALYTIC  RESULTS 

In  the  introduction  to  thi3  paper,  the  somewhat  unintuitive  assumption  was 
made  that  one  is  given  a  function  f  on  a  closed  set  T  such  that  i  attains  its 
maximum  on  any  nonempty  closed  subset  of  T  .  Corollary  11  provides  intuitively 
appealing  conditions  for  this  to  be  true.  Theorem  10  was  proven  by  Zoutendijk  [11] 

under  the  additional  assumptions  that  T  ■  En  and  f  is  differentiable  on  T  . 

Theorem  10: 

If  T  is  a  closed  convex  subset  of  En  ,  f  is  concave  and  upper  semi- 
continuous  on  T  ,  and  the  set  of  maxima  of  f  on  T  is  nonempty  and  bounded, 
then  {x  :  x  e  T  ,  f  (x)  >_  a}  is  bounded  for  all  a  . 

Proof : 

Let  W  be  the  set  of  maxima  of  f  on  T  .  Since  f  is  upper  semi- 

continuous  on  the  closed  set  T  ,  it  follows  that  W  is  closed  and  thus  W  is 

compact  and  nonempty  by  hypothesis.  Now  pick  any  x  e  W  and  any  y  >  0  such  that 

x  e  W  implies  |x  -  x|  <  y  .  Let  B  •  {x  :  x  e  T  ,  jx  -  x|  *  y}  .  If  B  *  0  , 

then  T  is  bounded  by  convexity  and  the  proof  is  complete,  so  assume  B  i  0  .  Let 

M  *  sup  f(x)  .  Since  f  is  upper  serai-continuous  on  the  nonempty  compact  set  B 
xcB 

it  follows  that  f  attains  its  maximum  on  B  ,  so  f (x)  >  M  since  Wfi  B  *  0  . 

Now  pick  any  a  <  f(x)  (the  result  follows  trivially  for  a  >_  f(x))  and  any 

x  e  T  with  |x  -  x|  >  y  and  f(x)  >  a  .  Let  X  • - ^ -  e  (0,1)  and 

|x-x| 

z  »  x  +  X(x  -  x)  .  Then  z  e  T  by  convexity  and  |z-x|=X|x-x|«y  so 

z  e  B  .  Thus  by  concavity 

(23)  M  >_  f(z)  >_  Xf (x)  +  (1  -  X)f(x)  >_  Xa  +  (1  -  X)f(x) 

and  substituting  X  - - into  (23)  , 

x  -  x 
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ffr)  -  M 

and  {x  :  x  e  T  ,  f  (x)  _>  a}  must  be  bounded.  [| 

Corollary  11: 

If  T  is  a  closed  convex  subset  of  En  ,  S  is  a  nonempty  closed  subset  of 
T  ,  f  is  concave  and  upper  semi-continuous  on  T  ,  and  the  set  of  maxima  of  f  on 
T  is  nonempty  and  bounded,  then  f  attains  its  maximum  on  S  .  Hence,  a  strictly 
concave  upper  semi-continuous  function  which  attains  its  maximum  on  En  (such  as 
any  strictly  concave  quadratic  function)  will  attain  its  maximum  on  any  nonempty 
closed  subset  of  E°  . 

Proof: 

Pick  any  y  e  S  .  Then  it  suffices  to  show  that  Sq  »  (x  :  x  E  S  ,  f  (x)  >_  f  (y) } 
is  bounded.  But  Sq  C  {x  :  x  e  T  ,  f(x)  >_  f  (y) )  which  is  bounded  by  Theorem  10.  |  | 

In  the  introduction,  it  was  mentioned  that  if  each  S.  is  the  intersection  of 

k 

En  and  all  the  linear  constraints  of  T^  that  are  active  at  x^  then  each  T^ 
is  the  intersection  of  no  more  than  n+1  closed  half-spaces.  This  follows  directly 
by  applying  the  following  result  and  Induction. 

Lemma  12: 

Suppose  ai  e  En  and  b^  e  E*  for  i  ■  1,  ...»  m+1  ,  and  x  ,  z  e  En  .  If 

a. ,  . . . ,  a  are  independent  (so  m  <  n)  , 
i.  m 

(24)  a^x  ■  bA  for  i  -  1,  ....  n  , 


a  , . »x  <  b  . , 
m+1  ra+1 


(25) 


» 


which  contradicts  (26).  | 
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4.  RELATED  WORK 

Van  Slyke  [8]  has  considered  the  result  of  Theorem  8  in  spaces  more  general 
than  En  and  has  applied  it  to  an  optimal  control  problem. 

C.  Eaves  and  W.  Zangwill  have  recently  informed  me  that  they  are  currently 
developing  a  theory  for  cutting-plane  algorithms  which  allows  inactive  constraints 
to  be  dropped  after  each  subproblem.  There  seems  to  be  some  overlap  between  their 
results  and  mine,  although  our  approaches  are  different. 


4 
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